Percolation in Interdependent and Interconnected Networks: 
Abrupt Change from Second to First Order Transition 
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Robustness of two coupled networks system has been studied only for dependency coupling (S. Buldyrev et. 
al., Nature, 2010) and only for connectivity coupling (E. A. Leicht and R. M. D'Souza, arxiv:09070894). Here 
we study, using a percolation approach, a more realistic coupled networks system where both interdependent and 
interconnected links exist. We find a rich and unusual phase transition phenomena including hybrid transition of 
mixed first and second order i.e., discontinuities like a first order transition of the giant component followed by 
a continuous decrease to zero like a second order transition. Moreover, we find unusual discontinuous changes 
from second order to first order transition as a function of the dependency coupling between the two networks. 
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During the last decade complex networks have been studied 
intensively, where most of the research was devoted to ana- 
lyzing the structure and functionality isolated systems mod- 
eled as single non-interacting networks lfll- [TTIl . However, 
most real networks are not isolated, as they either comple- 
ment other networks ("interconnected networks"), must con- 
sume resources supplied by other networks ("interdependent 
networks") or both lll2l - [l6ll . Thus, real networks continuously 
interact one with each other, composing large complex sys- 
tems, and with the enhanced development of technology, the 
coupling between many networks becomes more and more 
significant. 

Two different types of coupled networks models have been 
studied. Buldyrev et. al. flTf] investigated the robustness of 
coupled systems with only interdependence links. In these 
systems, when a node of one network fails, its dependent 
counterpart node in the other network also fails. They found 
that this interde pen dence makes the system significantly more 
vulnerable UtI llSll . In the same time, Leicht and D'Souza 
ITgll studied the case where only connectivity links couple 
the networks, i.e., "interconnected networks", and found that 
the interconnected links make the system significantly more 
robust. However, real coupled networks often contain both 
types of links, interdependent as well as interconnected links. 
For example, the airport and the railway networks in Europe 
are two coupled networks composing a transportation system. 
In order to arrive to an airport, one usually uses the railway. 
Also, people arriving to the country by airport usually use 
the railway. In this system, if the airport is disabled by some 
strike or accident, the passengers can still use the nearby rail- 
way station and travel to their destination or to another air- 
port by train, so the two networks are coupled by connectivity 
links. On the other hand, if the railway network is disabled, 
the airport traffic is damaged, and if the airport is disabled, 
the railway traffic is damaged, so both networks are coupled 
by dependency links as well. The important characteristics of 
such systems, is that a failure of nodes in one network caiTies 
implications not only for this network, but also on the func- 
tion of other dependent networks. In this way it is possible 



to have cascading failures between the coupled networks, that 
may lead to a catastrophic collapse of the whole system. Nev- 
ertheless, small clusters disconnected from the giant compo- 
nent in one network can still function through interconnected 
links connecting them to the giant component of other net- 
work. Thus, the inter-connectivity links increase the robust- 
ness of the system, while the inter-dependency links decrease 
its robustness. Here we study the competition of the two types 
of inter-links on robustness using a percolation approach, and 
find unusual types of phase transitions. 

Let us consider a system of two networks, A and B, which 
are coupled by both dependency and connectivity links. The 
two networks are partially coupled by dependency links, so 
that a fraction of A-nodes depends on nodes in network 
B, and a fraction qg of Z?-nodes depends on the nodes in net- 
work A, with the following two exceptions: a node from one 
network depends on no more than one node from the other 
network, and assuming that node A, depends on node Bj, 
then if Bj depends on some A/,, then h - i (see Fig. [Til. In 
addition, the connectivity links within each network and be- 
tween the networks (see Fig. [T]) can be described by a set 
of degree distributions (pf , , pf , ), where p^* , (pf , ) 
denotes the probability of an A-node (Z?-node) to have Ica 
(Icb) links to other A-nodes (Z?-node) and Icab (kBA) links to- 
wards B-nodes (A-nodes). In this manner we get a two di- 
mensional generating function describing all the connectivity 
Unks g^ixA, xb) = Z Pt kXA^"^ and g^(xA, xb) = 



kA,kAB 



kB,kt 



PkB,ki 



ksA ks 
A^A ^B ■ 



The cascading process is initiated by randomly removing a 
fraction 1 - /:> of the A-nodes and all their connectivity links. 
Because of the interdependence between the networks, the 
nodes in network B that depend on the removed A-nodes are 
also removed along with their connectivity links. As nodes 
and links are removed, each network breaks up into connected 
components (clusters). We assume that when the network is 
fragmented, the nodes belonging to the largest component (gi- 
ant component) connecting a finite fraction of the network are 
still functional, while nodes that are parts of the remaining 
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FIG. 1 : (Color online) Two types of inter-links where the dependency 
links (dashed arrows) are not necessarily bidirectional. The nodes of 
A and B are randomly connected with connectivity-links (full line). 
The functionality of some of the A nodes (red open circle) depend 
on B-nodes (purple solid circle) and vice versa. 



smaller clusters become dysfunctional, unless there exist a 
path of connectivity-links connecting these small clusters to 
the largest component of the other network. Since the net- 
works have different topologies, the removal of nodes and re- 
lated dependency links, is not symmetric in both networks, so 
that, a cascading process occurs, until the system either be- 
comes fragmented or stabilizes with a giant component. 

Let gAif, 4>) and gsiif, 4>) be the fraction of A-nodes and B- 
nodes in the giant components after the percolation process 
initiated by removing a fraction of 1 - (/j and 1 - of networks 
A and B respectively II llH . The functions gAiif, <p) and gsif, <p) 
depend only on (x^, xg) and Qq{xa, xb) (For details see SI) 
and the cascading process can be described by the following 
set of equations, 

(fil ^ p, 01 = 1, ^ (pigA(<Pl,^l), (1) 

02 = 1 - pgA(<Pl,4>l)), PI ^ (p2gB{f\,4>2), 
fl = p(l -?a(1 - gB{lf\,(/>2))), P^ = (p2gA{f2,(/>2), 

03 = 1 - - PgAim, 02)), P3 = 03§b(<^2, 03), 

where, 0,, (pi are the remaining fraction of nodes at stage / of 
the cascade of failures and Pf, Pf are the corresponding giant 
components of networks A and B, respectively. Generally, the 



n— step is given by the equations, 

(f„ = p(^l-qA{l - gB(fn-u4>n))), 
4>„ - 1 - pgA(iPn-\,4>n-\)\ 

Pi = ^ngAi^Pn, 4>n), Pf, = 0«gB(<^«-l , 0n)- 



(2) 



By introducing two new notations 

«A = gA(0oo,^oo), Ub = gB(0co,^co), (3) 

we can write the equations at the end of the cascading process, 

0OO = - ?a(1 - Ub)), (fioo - I - qBil - PUa), (4) 
and the giant components are. 



Pt = MA0CO = uap(^1 - ^a(1 - Ub)), 
Pt = ub(Pco = mb(1 - - PUa)). 



(5) 



In the case where all degree distributions of intra- and inter- 
links are Poisson distributed, the functions obtain a simple 
form. Assume kA and kB are the average intra-links degrees 
in networks A and B, and kAB, ^ba are the average inter-hnks 
degrees between A and B (allowing the case kAB + ^ba, since 
the two networks may be of different sizes), we obtain. 



ua = 1 
Ub - 1 



_ g -*AP«A ( 1 -9/1 ( 1 -«B )) -'^AS "8 ( 1 -9if ( 1 -P"A )) 
5 -*8A PllA ( 1 -9a ( 1 -"B )) -*^8 "»( 1 -9b ( 1 -P«A )) 



(6) 



Generally, for fixed parameters kA, kB, kAB, ksA, qA, qB and 
p, it is often impossible to achieve an explicit formula for the 
giant components and . However, one can still solve 
Eqs. ^ graphically and substitute the numerical solution to 
Eqs. (|5]). For example, we study the case where kA - kB = k 
and kAB - kAB = K. Fig.|2^ compares the numerical with the 
simulation results for P^ and Pf, as a function of p, showing 
that the analytical results of Eqs. (|5]) and ^ are in excellent 
agreement with the simulations. 

Next we are interested in the properties of the phase transi- 
tion under random attack, so first we determine the conditions 
when transition does not occur. This is the case when even all 
nodes of network A are removed {p - 0), for a given < 1, 
there still exists a giant component in network B (see circles 
in Fig.|2^) and no phase transition occurs. For Poisson degree 
distributions, if after the removal of all B-nodes that depend 
on the attacked A-nodes, the new average intra-link degree in 
network B is less than one, i.e.. 



Ml -qB) < 1, 



(7) 



a phase transition occurs. Therefore, the following analysis 
is based on condition (|7]i. In addition, we always set both 
dependency strengths, qA and qB, to be larger than zero. 



When the phase transition is of second order, i.e., the giant the second order threshold, for qA + ^ 
components at the percolation threshold is zero. Thus, ac- _ 
cording to the limit of system ^ at ua - ub - Q we obtain jj 1 - ^^(1 - qB) 



P'c' = 7= ^ ^^^^ . (8) 

[kA + {kBAkAB - kAkB){l - ^B)j(l - ^a) 
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FIG. 2: (Color online) a. Giant components and vs. fraction 
of remaining nodes, p, for N = 10000, k = 2 and = 1. Networks 
A (open symbols) and B (full symbols) for different (qA,qB) pairs: 
(0.8,0.1) (o); (0.8,0.8) («); (0.1,0.1) (□). The symbols represent 
simulations and the lines the theory. We see three types of behaviors: 
no phase transition (o), second order phase transition (o) and first or- 
der phase transition (□). b. Phase diagram showing the first order, 
second order and hybrid phase transition regimes and the boundaries, 
for = 1,A; = 3. In the second order transition regime, between the 
two dashed curve (red and blue) is the hybrid phase transition regime 
(details in Fig.[3]: and in the SI). Since the hybrid transition is contin- 
uous in the neighborhood of p^,, and jump occurs well above we 
classify a hybrid phase transition as a second order phase transition. 



When qA - ^ and Q < <\ this threshold becomes 

1 



> 1, 



-qs) 

which together with Eq. (|7]i implies that the phase transition 
must be of first order at p[ < 1 that will be determined later. 

Solving the first equation of system (|6]l, yields an explicit 
formula for ub, so that system ^ can be rewritten as 



Ub 



Ub 



log(l - Ua) + k^pjl - qA)UA 

kApqAUA + ^ab[1 - qsii - PUA)] 



= Hi(uaX (9) 



1 



„-/;BA"Ap(l-9.4(l-«8))-*e«e(l-98(l-«/i/')) = 



= H2{ua). 



and the intersection of the two curves (maximum solution of 
ua,ub) is the solution of the system. When the phase tran- 
sition is first order and p - p[, the curves of Eqs. ( fT9] ) are 
tangentially touching at the solution point, where. 



/ dH\ dH2 \ 
^ dUA duA ' 



(10) 



P=Pc 



Obviously, m^, ub and p can be treated as variables of 
Eqs. (fT9] l and ( fTOl i. Solving these equations, the minimal so- 



lution of p and the corresponding maximum ua, ub of the 
minimal p is the solution of the system at criticality. 

When networks A and B are fully dependent, i.e., qA = 
qB = I, system (|6]l yields a simple form 

Ma = 1 - expi^-puAUB(kA + Icab)], 
Ub = I - expi^-puAUB(kB + Icba)]- 
The size of the mutual giant component, P^a, is thus given by. 



■ e 



-P^Jke+kBA) 



), (11) 



which is similar to the solution of fully interdependent system 
UtIi . where the only difference is that the degrees of networks 
A and B are now replaced by Ia + Hab and Ub + kBA, respec- 
tively. Thus, interestingly, in a fully interdependent coupled 
networks adding connectivity inter-links has the same effect 
as increasing the intra-degree of the corresponding networks 
and therefore, in this case, the phase transition must be of first 
order. From Eqs. (fT9l l and (fTOl i. one can get the threshold. 



1 



kAil - "a)[-1 + (1 - "a)" - UAa(l - ua)"-^] ' 



(12) 



where, a = {kB + kBA)l{kA+kAB), and ua satisfies the equation. 



Ua 



UA{\-{\-UAr] 



(1 - ma)[-1 + (1 - uaT - UAa{\ - ua)"-^] 



(13) 

For fully interdependent system, both networks are of the 
same size and therefore kAB - kBA- 

By substituting p[! from Eq. (|8]l into Eqs. ( fT9] l and (fTOl i 
and evaluating both ua and ub we can derive and draw in the 
phase diagram, the boundary between the first and second or- 
der transitions (see dashed line in Fig. Wp)- The most inter- 
esting phenomenon, which to the best of our knowledge, has 
not been observed before, is that when the phase transition 
changes from first to second, there are discontinuities (abrupt 
jumps) of PtiiPc), P^iiPc) in the phase transition boundary 
(see Fig. [3^). The values of the jumps along the boundary are 
shown in Fig. [3j} (details in Fig. 1 of SI). This phenomenon 
contrasts most systems possessing both first and second order 
transitions. In physical systems usually, the first order jump 
in the order parameter, and related properties, such as the spe- 
cific heat, present a continuous change along the transition 
line when the system changes from first to second order 

In addition to the existence of jumps in P^(pc), P^ipc) at 
the boundary between the first and second order phase transi- 
tions, we find another unusual phenomenon. When one net- 
work strongly depends on the other, there exist hybrid phase 
transitions. By hybrid phase transition we mean that when 
increasing the attack strength, 1 - p, the size of the giant com- 
ponent jumps at p''. from a large value to a small value, and 
then continuously decreases to zero. A similar behavior has 
been found in bootstrap percolation li20ll . Since the second 
order transition is characterized by a giant component which 
is continuous in the neighborhood of pc, we regard, the hy- 
brid phase transition regime as a second order phase transition 
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FIG. 3: a. Size of giant components vs. dependency and connectivity links strength, for qg = \ and k = 3. The giant components size at 
Pc changes from zero to a finite value while changing qA and K. When q^ and K are at the boundary of dilferent phase transitions, the jump 
occurs, b. The values of Pt,(Pc) (°). P^tiPc) (n) along the boundary for qs = I and k = 3. c. Hybrid phase transition, for qg = l,qA = 0.35, 
k = 3 and A" = 0. 1. According to Eqs. Pt, and Pf, have the same properties as ua and ub respectively. At p a 0.66 the values of ua and ub 
jump, and then for lower p valve continuously approach zero. In the inset, simulation and theoretical results are symbols and lines respectively. 



regime (see Fig. |2]l}). For the hybrid phase transition, there 
exists a threshold p'^ at which the jump occurs (see Fig. [3]:). 
For p just below p'', the solution of Eqs. ( fT9] l for m^, ub, will 
jump to lower values (For more details see Chap. 3 in SI). Af- 
ter the jump, when p is further decreased, ua and ub approach 
to zero continuously which implies that the giant components 
sizes change to zero continuously. For example, for the pa- 
rameters qA - 0.35, = = 3 and K - 0.1, we obtain 
Pc = 0.556 and - 0.66. When p is just below 0.66, the 
giant components drops to smaller positive values like in a 
first order phase transition. After this discontinuous drop, the 
giant component's size continuously decreases to zero when 
decreasing p from 0.66 to 0.556 like a second order phase 
transition (see Fig.[3t). 

In summary, we studied the cascade of failures in coupled 
networks, when both interdependent and interconnected links 
exist, using a percolation approach. Although our detailed 
analysis is for ER networks, the theory can be applied to 



any network systems topology. We find that the existence of 
inter-connectivity links between interdependent networks, in- 
troduces rich and intriguing phenomena through the process 
of cascading failures. Increasing the strength of interconnect- 
ing links can change the transition behavior significantly and 
often brings up some counterintuitive phenomenon, such as 
changing the transition from second order to first order (as 
seen in Fig.|2]l}). We also find an unusual abrupt jump in the 
boundary between first and second order phase transitions at 
the critical point, which, to the best of our knowledge, has not 
been observed earher in physical systems. Moreover, when 
one of the networks strongly depends on the other network, 
unusual hybrid phase transitions are observed. 
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work and the Israel Science Foundation for financial support. 
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Supplementary Information 



I. HOW TO GET gA(>f>,<l>) AND gB((p,<p) 



We model the percolation process using the branching pro- 
cess approach. Let 0q{xa,xs) - 2 PkAk, ■^o"* ' ^"d 



b,kba a B ' 



be the degree distributions' 



generating functions. The probability of following a randomly 
chosen AB-link connecting an A-node of degree to a B- 
node with excess k^s degree (i.e., having total A to B degree 
of + 1 ) is proportional to {kAB + ^ )pf^ j^^^ , and the generating 
function for this distribution is. 



gfiXA,Xs)^ ^ 



(kAB + 1)P^, 



A'A,^A, 



2 k'As4,,k', 



M Ml 



(14) 



Analogously, we construct the other three excess generating 
functions g^^{xA, xg), g^^{xA, xb) and ^(xa, xb). 

After removing a fraction 1 - ^ of nodes in network A, and a 
fraction \ -(pof nodes in network B, we can set new arguments 
to the generating functions, so that, xa and xb will be replaced 
by \-ip{\-XA) and \-(f>(\-XB), respectively ll2ll - l23ll . Suppose 
gAif, (p), gsif, ip) are the fractions of A-nodes and Z?-nodes in 
the giant components after removal of 1 - (/? and \-(p fractions 
of networks A and B, respectively. Then we have, 

gAiip, = 1 - ^^(l - ^(1 - /a), 1 - 0(1 - fBA)\ (15) 
gB{^, 4,) ^ \ - g^^{\ - ipd - /ab), 1 - 0(1 - /b)), 

where, 

fA = - fd - /a), 1 - 0(1 - Iba)), (16) 

fAB = - ^(1 - /a), 1 - 0(1 - /ba)), 

fBA = gf{l - ^(1 - /ba), 1 - 0(1 - /b)), 
/b = (l - fd - fBA), 1 - ^(1 - /b)). 

When all of the degree distributions of inter and intra net- 
works A and B are Poisson distribution, all of the functions 
can be more simple. Assume Ha and kB are the average intra- 
links degrees in networks A and B and kAB, kBA are the av- 
erage inter-links degrees between A and B (allowing the case 
kAB 5^ ^BA, since the network sizes of A and B can be differ- 



r-AB 



ent), then we have Gq'*(xa) = e 
G^^ixA) = e*"'**-^''-!), G^*(xb) = e^sf^'i-i) and 



(xb) 



(17) 



^f^(XA,XB) = ^f*(XA,XB) = G^(Xa,Xb) = G^(Xa)G^«(X£) 
^f^(-«A>-*B) = ^f'*(-*A>-^B) - Gq(Xa,Xb) = Gq^{Xa)Gq^{Xb) 



Submitting above equations to to systems. ( fTSl ) and ( fTSI l, we 
get 

gAitf, 0) = 1 - exp{-^AX§A(<^, 0) - kABygBif, 0)}, (18) 

§b(^, 0) = 1 - exp{-fcBAXgA(i^, 0) - kBygBif, 0)}- 
II. ABRUPT JUMP ON THE BOUNDARY 

We rewrite the main system here 



ub - - 



log(l - Ma) + kAp(l - qA)uA 



= H,{ua\ (19) 



Mb = 1 

^dUA 



kApqAUA + ^ab[1 - ?b(1 - PMa)] 

. g-^SA«/(p(l-?A(l-«fi))-ifl«fl(l-9£(l-«AP)) = H2(Ua) 
P=P'c 



duA 



On the boundary between first and second order phase tran- 
sition, p[ - p'J . Substituting p'^. with p'J in system (1% and 
evaluating both ma and ub we can obtain the boundary be- 
tween the first and second order transitions. When we reduce 
the three equations to one equation, ma, ub should always 
be the maximum non-negative solution in [0,1]. When sys- 
tem. ( fT9b has more than one solution, we always choose the 
minimal non-negative value, p""" and the corresponding max- 



imum value solution u'^"'^. 



u'T" as the solution at the thresh- 



old. In some regime of the boundary, m™° * > and m'^'" * > 0, 
and of course p'""\uA = 0, ub - also is the system solu- 
tion. It means that there exist two intersections and both of 
them satisfy the tangential condition (as shown in Fig. [T9l ) on 
the boundary. This implies that when the order of the phase 
transition changes from first to second, Pt,[pcj, P^[pcj are 
discontinuous. 



III. HYBRID PHASE TRANSITION 



The minimum solution of p'"'" in [0,1] of system ( fT9] l is the 
Pc- Besides p""" if system ( fT9] l has another solution p'^. e (0, 1) 
and corresponding solution u'^, u'g, we can find the hybrid 
phase transition. {p'\ m^, m^) means that when p is little less 
than p'!, the solution «a, mb of the first two equations of sys- 
tem ( fT9l ) will jump to small values. After the jump, when we 
continue to decrease p to pc - p""", ua, ub will move to 
continually (as shown in Fig. |5]l. 
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A ' B 
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— ^1 
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0.2 0.4 0.6 0.8 1 
^B 

FIG. 4: Abrupt jump on the boundary, here qA = 0.394, qs = 0.8, k = 
3,K = 0.2. = p" = 0.5464 which is the threshold of the system. 
Although, both intersections (one of which is at the origin) satisfy 
the tangential condition, the m™*", k^" is the physical solution and 
the transition is of the first order. 
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FIG. 5: Hybrid transition analysis, for qg = l,qA = 0.35, k = 3 and 
K = 0.1, here pc x 0.556. p'' a 0.66. The maximum intersection S 
satisfies tangential condition. When continuously decreasing p, the 
solution of the system jumps from the maximum intersection S to the 
minimum intersection Q and then continuously decrease to zero. 



